Papers with wild disappears
Replicating and Extending “Because Their Treebanks Leak”: Graph Isomorphism, Covariants, and Parser Performance (2021.acl-short)
Copied to clipboard
| Challenge: | a small sample size and unreliable results suggest a correlation between parser performance and graph isomorphism is not observed in the wild. |
| Approach: | They propose to replicate a study which found graph isomorphism is a non-trivial variable . they also bin sentences by length and find correlation between parser performance and isopathism disappears . |
| Outcome: | The results show that the original analysis was unreliable and had methodological issues . the study also bin sentences by length and shows that the correlation between parser performance and graph isomorphism disappears when controlling for covariants. |